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Abstract 

An integer feasibility problem is a fundamental problem in many areas, such as 



operations research, number theory, and statistics. To study a family of systems with 
(~| . no nonnegative integer solution, we focus on a commutative semigroup generated by 

a finite set of vectors in Z'^ and its saturation. In this paper we present an algorithm 
to compute an explicit description for the set of holes which is the difference of a 
semi-group Q generated by the vectors and its saturation. We apply our procedure to 
compute an infinite family of holes for the semi-group of the 3x4x6 transportation 
CO ' problem. Furthermore, we give an upper bound for the entries of the holes when the 

. set of holes is finite. Finally, we present an algorithm to find all Q-minimal saturation 

[ points of Q. 

O ! 1 Introduction 

' The linear integer feasibility problem is to ask whether the system 

! Ax = b, x>0, (1) 

" ' where A € Z'^^" and 6 G Z'^, has an integral solution or not. In [11] we studied a generalized 

integer feasibility problem, that is, to find all b with no nonnegative integral solution for 
^ . a given A. In recent years, the generalized integer linear feasibility problem has found 

^ I applications in many research areas, such as number theory and statistics. For example, 

in number theory, the Frobenius problem is to find the largest positive integer b such that 
there does not exist an integral solution in ([1]) with d = 1 (e.g. [3], [2]). In statistics, one 
can find an application in the data security problem of multi-way contingency tables [9]. 
One of the challenge problems is the 3-dimensional integer planar transportation problem 
(3-DIPTP), that is, the question to decide whether the set of integer feasible solutions of 
the r X s X t-transportation problem 

r s t 

i=l j=l k=l 

is empty or not for a given right-hand sides u, v, w. Vlach provides an excellent summary 
of attempts on 3-DIPTP [12]. For sequential importance sampling [8], non-existence of 
integral solution causes difficulties in its implementation. 
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Note that there exists a real nonnegative solution but there does not exist an integral 
nonnegative solution in ([1]) if and only if b is in the difference between the semigroup Q 
generated by the column vectors of A and its saturation Qsat = cone(^)n lattice (^), where 
cone(^) is the cone generated by the columns of A and lattice(A) is the lattice generated 
by the columns of A. We assume cone(^) to be pointed. We call H = Qgat \ Q the set of 
holes of Q and call Q normal \{ H = %. H may be finite or infinite. 

In this paper, we present an algorithm which gives a finite description of H. Practically, 
even with all the currently available software packages, checking normality of Q is still a 
difficult computational question. Computing a finite description of all elements in H is 
even more difficult. The reader should note that for fixed matrix sizes d and n, there 
exists a polynomial size encoding of the generating function f{H;z) = '^h^u (where 

:= z^' ■ ■ ■ z""/) rational generating function 



Herein, / is a finite (polynomial size) index set and all the appearing data 7i € Q and 
cti, Pij £ are of size polynomial in the input size of A. In fact, this observation is based on 
a result by Barvinok and Woods [5] , who showed that there are such short rational function 
encodings for Q and for Qsat, and consequently, also for f{H;z) = f{Qsat',z) — f{Q;z). 
Although the proof by Barvinok and Woods is constructive, its practical usefulness still 
has to be proven by an efficient implementation. In contrast to the implicit representation 
via rational generating functions, in this paper, we present an algorithm to compute an 
explicit representation of H, even for an infinite set H. Such an explicit representation 
need not be of polynomial size in the input size of A. 

This paper is organized as follows: In Section [2] we set up basic notation and present 
our main results. Section [3] shows a combinatorial algorithm to compute the set of all 
fundamental holes of Q. In Section H] we describe an algorithm to compute a finite repre- 
sentation of holes in Q. Section [5] shows an application of the algorithm to 3-DIPTP and 
in Section [6] we describe the bounds on the size of entries in each hole in Q. Finally in 
Section [7] we show an algorithm to compute the set of all Q-minimal saturation points. 

2 Basic notation and the main results 

The main result in this paper is the following. 

Theorem 2.1. There exists an algorithm that computes for an integral matrix A a finite 
explicit representation for the set H of holes of the semigroup Q generated by the columns 
of A, that is, the algorithm computes (finitely many) vectors hi € and monoids Mi, 
each given by a finite set of generators inTT^ , i £ I, such that 




H = \J {{hi} + Mi). 
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In fact, we explicitly present such an algorithm. Note that Mj could be trivial, that is. 
Mi = {0}. See Example 12.21 below for an example of such an explicit representation. 

One basic object needed in our construction is the set F of fundamental holes. We call 
h € H fundamental if there is no other hole h' £ H such that h — h' £ Q. Note that in 
contrast to H, F is always finite. For every hole h £ H there exists a fundamental hole 
f G F such that /i € / + Q. In view of these facts our algorithm consists of the following 
two main steps: 

1. First, compute the set F of fundamental holes. 

2. Then, for each of the finitely many f £ F, compute an explicit representation of the 
holes in f + Q. 

Moreover, we can use our algorithm to bound the entries of /i € in case that H is 
finite. 

Theorem [Ml Let A C Z'^^" he of full row-rank. Let D{A) denote the maximum 
absolute value of the determinants of a d x d suhmatrix of A. Moreover, let Mf[A) = 
maxj=i^...^rf \ Aij \ — 1. Then, if H is finite, the inequality 

\\h\\oc < {d+l)Ml{A)D{A) 

holds for every h £ H . 

Finally, we can use the above approach to compute the set of all Q-minimal saturation 
points of Q (Section!?]). Herein, we call s € Q a saturation point of Q, if s + Qsat ^ Q- The 
set of all saturation points of Q is denoted by S. We call s € a Q-minimal saturation 
point if there is no other s' £ S with s — s' (z Q. The set S of saturation points, considered 
as a Q-module, is often called a conductor ideal (e.g. [6]). S is finitely generated as a 
Q-module and hence the set of Q-minimal saturation points is finite. 

We illustrate the above notions with the following simple example. 

Example 2.2. Let 

A=(^ ^ ^ ^ 
V 2 3 4 

with the single fundamental hole (1,1)^ and with infinitely many holes 

H = {{l,iy + a ■ {l,Oy : a e 

where Z_|_ denote the set of nonnegative integers. Q has three Q-minimal saturation points: 
(1,2)T, (1,3)T, and (1,4)t. See Figured) □ 

In the following two sections we demonstrate how to perform the steps for Theorem 
12.11 algor ithmicallv. We accompany the theoretical construction with our running example. 
Example [ 
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(0,0) 



Figure 1: Non-holes, holes and fundamental hole for Example 12.21 



3 Computing the fundamental holes F 

In this section, we compute the set F of fundamental holes h ^ H. To enumerate all 
fundamental holes, we first give a short proof that the number of fundamental holes is 
indeed finite. Let A^i denote the ith column of A. 

Lemma 3.1 (Takemura and Yoshida [U]). The set F of fundamental holes is a subset of 



Proof. Each f F lies in cone(A) and thus can be written as / = AX = Y17=i ^i^-i 
some A > 0. If Xj > 1 for some j E {1, . . . ,n} then f = f — Aj £ cone(j4) n lattice(^) 
would contradict the Q-minimality of /, since f — f = A,j E Q. Consequently, Aj < 1 for 



This shows that F is finite and also gives a finite procedure to enumerate F: 

• Enumerate P fl lattice (A). 

• Check for each z G PR lattice (^) whether z is a fundamental hole or not by solving 
AX = z,X (z and by checking whether z — A_i G P n lattice(A) C Q for some i. 

Practically, this construction can be sped-up as follows. First compute the (unique) 
minimal Hilbert basis (or better: integral basis) B of cone(74) nlattice(A). Again, similarly 
as above, one can show that B C P. B contains no hole of Q, Q must be normal. 
Otherwise, every hole of Q appearing in B must be fundamental, since B is minimal. 
Finally, if / G F is not in B, f can be written as a nonnegative integer linear combination 
of elements in B, since / € cone(^) lattice (^) and since B is a Hilbert basis (integral 
basis) of cone(yl) fl lattice(^). This representation cannot have summands that are not 
fundamental holes, since otherwise / is would not be fundamental. To see this, let 




all i. 



□ 




bt^BDF 
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with Ylbi^BnF l^bb 7^ 0. Observe, that 



beBnF 

must be a hole of Q, as otherwise / is not a hole. But since 

/-/'= E ^^^eQ, 

b^BnF 

f cannot be a fundamental hole. 

Thus we can enumerate F as follows: 

• Compute the Hilbert basis (integral basis) B of cone(^) n lattice(^). 

• Check whether each z € -B is a fundamental hole or not, that is, compute B F. 

• Generate all nonnegative integer combinations of elements in B D F that lie in P 
and check for each such z whether it is a fundamental hole or not. 

Example 12.21 cont. In our example, the lattice L generate by the columns of A is 
simply lattice(A) = Z^. With this, the Hilbert basis B of cone(^) fl lattice(A) consists of 
5 elements: 

i? = {(l,0)T,(l,l)T,(l,2)T,(l,3)T,(l,4)T}, 

out of which only (1, 1)''' is a hole. Being in B, (1, l)""" must be a fundamental hole. Thus, 
B f] F = {{1,1)'^}. Constructing nonnegative integer linear combinations of elements from 
B nF, we already see that the combination 2 • (1,1)^ = (2,2)''' is an element of Q and 
consequently, there is no other fundamental hole in Q, i.e. -F = {(1, 1)^}. □ 

4 Computing the holes in / + Q 

In this section we discuss how to compute the holes in f + Q for each fundamental hole 
f ^ F. Note that a point z £ f+Q is either a hole or it belongs to Q. That is, every non-hole 
in / + Q belongs to if + Q)nQ. Moreover, if z e (/ + Q) nQ then also z + AX G {f + Q)nQ 
for all A € . Thus we define a monomial ideal Iaj G Q[xi, . . . , x„] by 

Iaj = {x^ ■.Xeri,f + AXe{f + Q)nQ). (2) 

By construction, f+AX, X € , is not a hole of Q if and only if rc^ G ^Aj- Therefore, we are 
looking for an explicit description of the monomials not belonging to the monomial ideal 
Iaj- These monomials are usually called standard monomials and there are algorithms to 
compute an explicit disjoint or non-disjoint representation of them once ideal generators 
for Iaj are known. Via the (typically non-injective) linear transformation i—^ f + AX, 
one recovers an explicit (usually non-disjoint) representation of all holes of Q in f + Q. 
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It remains to find (minimal) generators for Iaj- Tlie minimal generators correspond 
to the <-minimal elements in the set 

Laj = {X eZl -.Bfi such that f + AX = Afi}. 

To compute these minimal elements directly inside this projection is a hard computational 
task and deserves further investigation. Let us therefore compute a usually non-minimal 
generating set for /^j from a higher-dimensional problem. 

Lemma 4.1. Let M be the set of <-minimal solutions (A, /i) to f+AX = Afi, (A, fi) G Z^. 
Then 

I^j = {x^ -.BfiGZl such that (A, ^) G M). 

Proof. Let Aq G -^A,f be <-minimal. We show now that there exists some /zq G such 
that (Aq, /^o) is a <-minimal solution to / + AX = Afi, (A, fi) G Z^". Then, as claimed, the 
minimal generator is contained in the given set of generators for Iaj- 

Suppose on the contrary, that for every /i G the vector (Aq, /u) is not a <-minimal 
solution to / + ^A = Afi, (A, fj.) G Z^". Let fiQ be a <-minimal solution to / + AXq = Afi, 
fi G Z" . Then, by our assumption, there is some vector (A', fi') G Z^ with / + AX' = Afi', 
iX',fJ,') < (Ao,/io)) and {X' , fx') ^ (Ao,/xo)- If A' ^ Aq holds, we have a contradiction to 
Aq being <-minimal in L^j- If A' = Aq and fi' ^ fiQ holds, we have a contradiction to 
fiQ being a <-minimal solution to / + AXq = Afi, fi G Z". This shows that (Ao,/Uo) is a 
<-minimal solution to / + ^A = Afi, (A, /i) G Z^", as we wanted to show. □ 

Example 12.21 cont. Let / = (1, l)""" and consider {f + Q) Q. The linear system to 
solve is 

1 + Ai + A2 + A3 + A4 = /Lii + fl2 + + fJ-4: 

1 + 2X2 + 3A3 + 4A4 = 2fl2 + 3/i3 + 4/i4 

with Xi,fij G Z+,i,j G {1,2,3,4}. 

4ti2 gives the following 5 minimal inhomogeneous solutions (A,/i) G Z8: 

(0, 0, 0, 2, 0, 0, 3, 0)^ (0, 1, 0, 0, 1, 0, 1, 0)^ , (0, 0, 1, 0, 1, 0, 0, 1)^ (0, 0, 1, 0, 0, 2, 0, 0)^ , (0, 0, 0, 1, 0, 1, 1, 0)^ 
Thus, we get the monomial ideal 

Iaj = {xl,X2,X3,X3,X4) = {X2,X3,X4), 

whose set of standard monomials is {x" : a G Z+}. Thus, the set of holes in / + Q is 
explicitly given by 

{/ + aA,i : a G Z+} = {(1, ly + a(l, Oy : a € Z+}, 
as already claimed above. □ 
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5 Infinitely many holes for 3x4x6 transportation problem 



In this section, we apply the procedure from the last section to the semi-group Q spanned 
by the matrix A defining a 3 x 4 x 6 transportation problem. Already in 1986, Vlach 
|12j has shown that this semi- group is not normal by explicitly stating a hole /, which is 
fundamental. He showed that Ax = f,x > has a (unique) rational solution, which in 
turn is fractional. In the following, we construct a finite representation of all holes of Q 
belonging to f + Q. We show that there are in fact infinitely many such holes. 

The semi-group of the 3x4x6 transportation problem is of special interest, as it is 
the smallest three-dimensional transportation problem for which it is known that the 
associated semi-group is not normal. The only two cases of (also higher-dimensional) 
transportation problems for which the normality question is still open are those of sizes 
3x4x5 and 3x5x5 p|0]. The previously open case 3x4x4 has been solved by the third 
author using the software package NORMALIZ [7]. The associated semi-group is normal. 

For the 3x4x6 problem, a fundamental hole / given by Vlach [12] is defined by the 
following three matrices: 



/I 1 1\ 

1 1 1 

1 1 1 

V 1 1 1 / 



/ 1 1 \ 

1 1 

1 1 

1 1 

oil 
V 1 1 y 



and 



/ 1 1 \ 
110 
110 
11 
10 10 
V 1 1 / 



The unique point in this 3x4x6 transportation polytope {z G M7'^ : Az = /, z > 0} is 
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If A^^ijk denotes the column of A corresponding to variable Zijk, then the monomial ideal 
Iaj constructed in the previous section is generated by the 48 monomials Xijk for which 
^ijk ~ This can be shown as follows. 

Firstly, 1 ^Aj^ since f ^ Q. Secondly, using 4ti2, one verifies for each of these 48 
indices that / + ^.,ijA: = has a nonnegative integer solution fi € Z''^, by explicitly 
constructing such a solution. Finally, as it remains to look only for ideal generators of 
Iaj not divisible by the 48 monomials x^fc for which z*^-^ = 0, the linear system from the 
previous section simplifies to 



f + A'X' = An,Xe 



772 



where A' is formed out of the 24 columns A^^ij/. of A for which z*^-^ > 0. This system 
does not have an integral solution. In fact, the only real solution is (A',/x) = (0,z*). To 
see this one either solves this system, for example using 4ti2, or one observes that the 
vector f -\- A'X' has many zero entries that are present for arbitrary choices of A'. These 
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zero entries imply that /Xjjfc = for all triples ijk for which z*^-^ = 0. The remaining linear 
system 

/ + A'X' = Afi', A G /i' e Zf, 

has a unique real solution, namely (0,z*'), which can be checked by applying Gaussian 
ehmination to the system A{n' - A') = /, (/i' - A') e M^^. 

Thus, the set of holes of Q belonging to f + Q are given by / + semi- group (^'). 



6 Computing bounds 

For this section, let us assume that the set H is finite. We will now use our approach above 
to establish bounds on the size of the entries for each h ^ H. Clearly, such a bound can 
then be used to show that H cannot be finite if a hole with sufficiently big entries has 
been found. 

Theorem 6.1. Let A C ^<^x" 5e of full row-rank. Let D{A) denote the maximum ab- 
solute value of the determinants of a d x d submatrix of A. Moreover, let Mp{A) = 
maxj=i^,,,^^ ^"^j^ \ Aij \ — 1. Then, if H is finite, the inequality 

\\h\\oo < id+l)Ml{A)D{A) 

holds for every h ^ H. 

Proof. First, we can bound the elements f £ F using the relation 



F C ( 



^AjAj : < Ai,...,A„ < 1 [. . 



Thus, 

n n 

holds for all / G F and all i = 1, . . . , d. 

Next, as H is finite, all ideals Iaj^ f ^ F, must have a finite set of standard pairs, which 
is equivalent to saying that there must be a monomial generator for every i = 1, . . . , n. 
Such a monomial generator corresponds to a minimal inhomogeneous solution (aj,/u) to 
/ + aiA^i = An, Oi G ;U € . Let us now bound the values for such a minimal a^. 

First, the minimal inhomogeneous solutions (oj, //) to f + aiA,i = Afi, Oi € € 
correspond exactly to the minimal homogeneous solutions to fu + OiA^i — Afi = 0,ai,u £ 
Z+,/i € Z" with u = 1. Each entry in a minimal homogeneous solutions, however, can be 
bounded by {d + 1) times the maximum absolute value D{f A^iA) of the determinants of 
a maximal submatrix of the defining matrix (/ A^iA). 

Thus, in particular, 

ai<{d + l)D{f A,iA) <{d+l) max |/(^) | • L>(A,i - A) = {d + 1)Mf{A) ■ D{A). 

j=l,...,d 
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Consequently, we can bound the entries of a hole in / + Q by giving bounds for 

n 

For h £ {f + Q) n H , the ith entry is bounded as 

n 

n 

< Mf{A) + ^{{d + 1)Mf{A)D{A) - l)\Aij\ 

n 

= Mf{A) + {{d+l)MF{A)D{A) - l)^\Aij\ 

< Mf{A) + {{d + 1)Mf{A)D{A) - 1)Mf{A) 

= {d+l)M^p{A)D{A). 
As this bound is independent on f £ F, we have 

\\h\\oo<id + l)MUA)D{A) yheH, 
if H is finite. □ 
Example 12.21 cont. In our example, we have 

• d+l = 3, 

• Mf{A) = max(l + 1 + 1 + 1, + 2 + 3 + 4) = 9, and 

• D{A) = max |2 x 2 determinant of A| = | det ( q 4 ) | = 4. 

Thus, if H was finite, we would get the bound \\h\\oo < 3 • 9^ • 4 = 972. In our example, 
however, one can easily verify that (1000, 1) is a hole. Moreover, it violates the computed 
bound. Consequently, H cannot be finite. □ 

7 Computing all Q-minimal saturation points 

In this section, let S denote the set of saturation points of Q, that is, the set of all those 
s £ Q such that s + Qsat ^ Q- Let us now show how the above approach can be used 
in order to compute min(S'; Q), the set of all Q-minimal points in S. We also recover the 
known fact that min(S'; Q) is always finite. We state the following theorem. 
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Theorem 7.1. 

s= r\m + Q)nQ)-f] 

and hence 

S = {AX\x^e f~] Iaj}, 

where Iaj is defined in 
Proof. 

s £ S <^ s € Q and s + Qsat ^ Q (by definition) 

44> s gQ and s + H (since Qsat = QU H and s + Q C Q, Vs G Q) 

s G Q and s + F CQ (since H O F + Q) 
^ S + /G/ + Q and S + /CQ V/gF 
4^ s + /G(/ + Q)nQ V/GF. 

Consequently, we liave s G S <^ s G Clf^piHf + <5) H Q) — /]. Furthermore with s = AX 
for some A G (as s G Q), we get s G S <^ x'^ £ H/eF ^^.J- d 

Define 

Then I a is a monomial ideal being the intersection of the monomial ideals Iaj- I a can 
be found algorithmically, for example with the help of Grobner bases. The elements s G 
min(S'; Q) correspond exactly to the minimal ideal generators x'^ of Ia via the relation 
s = AX. (Note, however, that this relation need not be one-to-one. There may be many 
minimal ideal generators corresponding to the same Q-minimal saturation point.) 

Example 12.21 cont. In our example, we have Ia = Iaj = {x2tX3,X4), as there exists 
only one fundamental hole /. The three generators of Ia correspond to the three Q-minimal 
saturation points (1,2)''", (1,3)"'', and (1,4)"'". □ 
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